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Abstract 

We prove the existence of correlations between the equilibrium states at different temperatures of 
the multi-p-spin spherical spin-glass models with continuous replica symmetry breaking: there is no 
chaos in temperature in these models. Furthermore, the overlaps satisfy ultrametric relations. As a 
consequence the Parisi tree is essentially the same at all temperatures with lower branches developing 
when lowering the temperature. We conjecture that the reference free energies of the clusters are also 
fixed at all temperatures as in the generalized random-energy model. 

Introduction 

The effects of temperature changes currently are the most interesting in spin-glass studies. The coexis- 
tence of chaos (or rejuvenation) and memory ^, Q is particularly puzzling. A first non-trivial problem 
is whether these effects are universal, i.e. whether they are present in different real spin-glasses || and 
in numerical simulations of microscopic models Q; the main problem, however, lies in the theoretical 
explanation of these phenomena. If one admits that the static (equilibrium) free-energy landscape is 
somehow relevant to the off-equilibrium dynamics, the two effects of chaos and memory seem to contra- 
dict each other: the former points in the direction of absence of correlation between the equilibrium states 
at different temperature, while the latter points in the opposite direction. A qualitative explanation of 
the coexistence of the two effects has been given in terms of a hierarchical picture in which states at 
different temperatures are organized on the same ultrametric tree, whose details are revealed by lowering 
the temperature @, [H [|. Recent numerical and theoretical work on the subject has confirmed that the 
generalized random energy model (GREM) || [u|, a model with such a landscape structure, displays 
chaos as well as memory [pT| . However, the GREM is defined through its phase space, without any 
reference to any underlying microscopic description; therefore it would be interesting to find out whether 
there are spin-glasses that behave like the GREM. The question is whether equilibrium states at different 
temperatures are correlated or not and which is the nature of the correlations. The hypothesis of chaos 
in temperature affirms that they arc uncorrelated in finite dimensional systems |l2[ |l3f ; this has been 
studied analytically in a number of paper [ ^4| [l5[ [l6| ; We have questioned the hypothesis validity in the 
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Sherrington-Kirkpatrick (SK) model in a recent paper [[H], henceforth labeled [I]. The problem has also 
been investigated numerically |l^, jl9|, |2(| . It has also been shown that the random energy model (REM) , 
which is non-chaotic by definition, is capable of producing strong rejuvenation signals [ pl| . On the 
other hand various attempts are underway to substantiate the idea of some kind of hierarchical structure 
underlying the phenomenology in the context of real-space theories like the droplet model |2^, |2^| . 

In this paper we consider the mean-field multi-p-spin spherical spin-glass models for values of the 
coupling constants such that they display full replica symmetry breaking (RSB) p3 . It must be remarked 
that the analysis of the off-equilibrium dynamics (2f| of these models has revealed the coexistence of chaos 
and memory pfj. We study the correlations between the equilibrium states at different temperatures 
following the lines developed in [I], where the problem has been put in connection with the existence of 
a particular class of solutions of the saddle point (SP) equations obtained in the replica framework. In 
section 1 we prove that these solutions exist for the class of models considered, implying strong correlations 
between states at different temperatures, i.e. no chaos in temperature. 

These solutions are built with Parisi matrices |Q| and in section 2 we show that this structure implies 
ultrametric relations between the overlaps of states at different temperatures. These ultrametric relations 
determine a one-to-one correspondence (except at the lower levels) between the trees of states at two 
different temperatures in such a way that to a cluster of states at temperature T\ , at a level of the T\ tree 
labeled by some value q\ of the overlap, corresponds a cluster of states at temperature T 2 at a level of the 
T 2 tree labeled by the same value q% = Qi- We call "twins" any two clusters in such a correspondence. 
Specifically, a state at temperature T\ corresponds to a cluster of states at temperature T 2 < T x whose 
minimal overlap is given by qEAi- Therefore each state at temperature Ti can be considered as the father 
of many states at temperature T 2 . A son has only one father, and it has an overlap lower than qEAi with 
all the other states at T\ . The meaning of the correspondence between the trees at different temperatures 
is that any relationship between a state or cluster a at T 2 and any other state or cluster 7 at T\ or T% is 
univocally determined by the relationship between 7 and the twin of a at T\. In particular, given a state 
7 at T 2 and its father r at T\ > T 2 , the overlap between 7 and any state A at T\ is given by q^ = <7Ar- 

Each state of a spin-glass system at a given temperature has a certain statistical weight P a determined 
by the Gibbs measure. According to the Parisi solution Q the fluctuations of the weights with the disorder 
can be described through a stochastic process involving the free energies f a of the states, which are defined 
as P a — exp[— f3f a ]/ ^ fc exp[— (3f k ] [^7[ Given the tree of states, one considers a given level k and 
assigns independently to each cluster of states at this level a reference free energy chosen randomly such 
that the average number of clusters with free energy between / and / + df is given by 

dAf(f) = exp[Px(q k )f]df (1) 

Where x(qk) is the inverse of the Parisi function q(x). After having applied the procedure to every level 
of the tree, the free energy of a given state is set to be the sum of the reference free energies of the clusters 
to which it belongs at the various levels. For instance, if the state a belongs to the cluster i\ at the first 
level of the tree, to the cluster iii 2 at the second level of the tree and so on, its free energy is given by 

(2) 

The distribution obtained has various interesting features; for instance, in each sample there are only few 
states with a finite weight, while there is an infinite number of states that carries an infinitesimal weight. 

Since we found a one-to-one correspondence between the trees of states at different temperatures, 
it is natural to whether if there are also correlation between the weights. In the replica framework the 
standard procedure to cope with this problem requires the computation of sums over all the different 
solutions of the saddle point equations, in order to obtain the cumulants of the distribution function of 
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the weights. When considering a system at a given temperature, this can be done noticing that all the 
solutions are permutations of the standard Parisi solution |2j| [l| ; therefore the sum over solutions can be 
replaced by a sum over replica indices; Unfortunately when considering systems at different temperatures 
the solutions are not permutations one of the other and we are unable to sum them all. However, in 
section 3 we conjecture that the weights distribution is identical to that of the GREM class of models. In 
the GREM the tree of states is the same at all temperatures by definition and the reference free energies 
of the clusters are constant too ||, [H]]. Their distribution obeys the law (|l|) with (3x{q) replaced by 
y u {q), a function that depends on the model. In analogy to this we guess that in the models we arc 
considering the reference free energy of a given cluster at T\ is equal to the reference free energy of its 
twin at T2; we notice that since for this models we have (3x(q,T) — y u {q), (where y u (q) depends on the 
coupling constants but not on the temperature), this is consistent with the fact that the same set of free 
energies obeys law (|l|) at all temperatures. This belief is motivated by the fact that there is a one-to- 
one correspondence between the solutions of SP equations of the multi-p spin spherical model and the 
solutions one finds in the analogous replica treatment of the GREM |fl6| . Indeed, the solutions have the 
same formal structure expressed in terms of the function y u (q) and the differences between the models 
shows up only in the actual values of this function. Since for every solution of the multi-p spherical 
spin-glass models there is a correspondent solution of the GREM, we expect that the sums over solutions 
give equal results in the two models; more precisely we expect the results to have the same dependence 
on the function y u (q). Accordingly, the correlations between the weights at different temperatures will 
be equal in the two classes of models. 

The previous conjecture could be proved if we were able to carry out the sum over all the solutions. 
This problem is common to many models where one would like to recover within the replica framework a 
result which is known a priori (e.g. in the REM ]30[|), or which can be obtained through different methods 
(e.g. the spherical p-spin model where the absence of chaos in easily seen within the TAP approach pi). 
In section 4 we discuss some technical difficulties connected with this problem. At the end we give our 
conclusions. Technical details are skipped to the appendices. 

1 Correlations between states at different temperatures 

We recall the method discussed in [I] to study the correlations between states at different temperatures. 
The replica trick is usually used in order to compute the average over the disorder of the free energy 
by computing the moments of the partition function Z n . In the thermodynamic limit saddle point (SP) 
equations are obtained for the order parameter which is an n x n matrix Q a b- An outcome of the 
computation is that the order parameter is connected to the distribution of the overlaps through the 
relation 



Where the function P{q) is the averaged probability density of finding two states with overlap q according 
to their Gibbs weight, and a and b are two different replica indices (e.g. 1 and 2). In the r.h.s. of (||) there 
appears a sum over all the different solutions of the saddle point equation with the same (maximum) free 
energy; indeed, as soon as replica symmetry is broken, we have many solutions: given a certain solution 
others can be obtained through a permutation of the replica indices. However, in the isothermal case, 
all the solutions are given by the Parisi solution plus its natural permutations; therefore the sum over 
them can be replaced with an average over the replica indices multiplied by the total number of different 
solutions, which in the n — ► limit goes to I |2j| pL In [I] it has been shown that the correlations 
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between states at different temperatures can be investigated through the computation of the n — ► limit 
of the quantity (1 — Z n (T\)Z n i^T-i)) jn. As a matter of fact, we are not interested in its actual value 
(which must be equal to the sum of the free energies at temperature T\ and T%), but in the saddle point 
equation obtained by applying the replica trick to the whole Z n (T 1 )Z n (T 2 ) and not to Z n (T 1 ) and Z n (T 2 ) 

separatelyfl In this case one obtains SP equations for a 2n x 2n matrix Q = \ | , where Q\, 

[p* Q2 J 

Qi and P are n x n matrices. The advantage of this procedure is that the matrix P encodes information 
on the correlations between states at different temperatures; indeed, through the same steps that led to 
(0) it can be shown that 



?riT2 = / QTiT2 P {QTiT2)dq T iT2 = Urn V P c 

J n — >U L — ' 



all solutions 



Where the function P(qriT2) is the generalization of the P(q) to states at different temperatures. As 
above, we have to sum over all the solutions of the SP equations: this is quite a delicate point; indeed 
we do not expect that all solutions be natural permutations of a single solution as in the isothermal 
case (i.e. the standard Parisi solution). Actually, there arc infinite solutions corresponding to different 
parameterizations and we don't know how to sum them all. However, it is possible to reconstruct 
the function P(qTiT2) in &n indirect way by knowing the weight distribution of the equilibrium states. 
We have applied the method to the spherical spin-glass model with multi-p-spin interaction plj. The 
Hamiltonian of the model is defined as 

oo 

H = y ] Ji 1 i 2 ...i p Si 1 Si 2 . . . Si p + h~^^ Si 

p=2 i 1 <i 2 <...<ip i 

The J's are independent Gaussian random variable with zero mean and variance (jf^ = (p ~ 
1)! Jp 7V 1_P . The spins are subjected to the spherical constraint ^ Sf = Na. Introducing the function 



OO 

/(«) - E - J k 



P =2P 



The replicated free energy reads 



2pF n = -I3 2 Y}f{Qab) + H 2 Q ab ] - TrlnQ - n 

ab 

where the variational parameter is an n x n matrix Q a 6 with diagonal q^ = a. The SP equations then 
read 

P 2 f(Q ab ) + f3 2 H 2 = - (1) ^ (4) 



1 This quantity is actually the logarithm of the partition function of the two systems. To make the text more readable 
we will refer to it as the "free energy" of the two systems, while the free energy of a single system is the logarithm of its 
partition function multiplied by {3, the inverse of its temperature. Therefore a claim like "the free energy of the two systems 
must be equal to the sum of the free energies at temperature Ti and T2" is shorthand for "the logarithm of the partition 
function of the two systems must be equal to the sum of the logarithms of the partition functions at temperature Ti and 
T 2 ". 



4 



Expressing Q a b as a Parisi function we obtain the solution as q(x,T) — q u ((3x) where q u {y) is defined as 
the inverse of the universal function 

/'"(<?) 



yu{q) -- 

with the value of q{\) fixed by 



2/"(g)3/a 
1 

' /V/"(<z(i)) 



In the presence of a small magnetic field there is also a small plateau of temperature-independent height 
qu fixed by the condition 

H 2 = q H f"(q H ) - f'(q H ) 

When we consider simultaneously two systems at different temperature, we get the following expression 
for Z n (Ti)Z n (T2) in the thermodynamic limit 

F n = lnZ"(Ti)Z»(T 2 ) = -01 ^(/(Qi ab ) + H 2 Q lab ) - (3 2 ^(/(Q 2q6 ) + H 2 Q 2ab )+ 

ab ab 

- 20x02 J2(f( P »b) + H ' 2p ab) - TrlnQ - n (5) 

ab 

The corresponding SP equations are similar to those for the isothermal case ^ and are reported in 
appendix 2. A solution of the SP equations is certainly the one with P = and Q\ and Q 2 equal 
to the corresponding isothermal solutions. Its free energy is given by the sum of the free energies at 
temperatures T\ and T 2 as expected. The problem is whether other solutions exist with a non-zero P 
and with the same free energy of the P = solution. In [I] a particular structure was proposed for these 
F ^ solutions (called non-chaotic, since their existence implies absence of chaos in temperature); we 
found that solutions having such a structure do exist for this class of models. Actually there is an infinite 
number of solutions which are parameterized by the value pd of the diagonal of P, whose value ranges 
from zero to a maximum one, which, for these models, turns out to be the self-overlap of the states at the 
higher temperature. The solution with P = is included in this set and corresponds to the value pd = 0. 
It is very interesting to notice that they exist also when the two systems at different temperatures are 
subjected to the same magnetic field (see appendix 2). Here for simplicity we will refer to the H = 
case. For a given value of pd the solutions in terms of the three functions qi(x), q% (x) and p(x) are 

Qu((Pi + lh)x) for x < p^y u {Pd) 

Qsi x ) = \ Pd for jp^- 2 yu{Pd) <x< ^VuiPd) (6) 

q u {f3 s x) for -^y u (Pd) < (T s ) 

p{x) = j 9«((A+/W fOT x < v£jEVu(Pd) 

Pd for pTT^y^P^ - x - 1 

Where q u {y) and y u {q) are the universal function defined above. These solutions can be built for any 
couple of temperatures T\ > T 2 both below the critical temperature and for any pd between zero and 
<7i(l) which is the self-overlap of the states of the system at the higher temperature. The solutions are 
sketched in figures 1 and 2. Notice that gi(x),q 2 (x) and p(x) are all equal in the small- x region. This 
is connected with the fact that this class of models verifies the scaling q(x,T) = q(x/T). We skip to 
appendix 2 the demonstration that these functions solve the SP equations and have the correct free 
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Figure 1: The solutions for pd ^ 0. In the small-a; region they are all equal to q u ((Pi + Pi)x) until the 
point x c where p(x) = pd, for x > x c p(x) is constant and equal to pd, while qi(x) and qi [x] after an 
intermediate plateau are joined respectively to q u {Pix) and q u (02%)') Pd can take values between zero and 
qiEA- 



energy. It must be remarked that the solutions are formally the same which have been found with 
a similar treatment of the GREM with a different model-dependent function y u (q). At this stage we 
can infer that the function P{qTiT2) has a non-zero support from zero to the self-overlap of the states at 
the higher temperature. 

2 Ultrametricity 

The solutions we found imply ultrametricity between states at different temperatures of a given system. 
To see this we must consider the probability -P(qi2, Q13, Q23) of extracting three states at different tem- 
peratures with assigned values of their mutual overlap. If we assume, for instance, that states 1 and 2 
are at temperature T\ and state 3 is at temperature T2, this function is related to the solutions of the 
SP equation through the following relation 



We are not able to perform the sum over solutions in r.h.s of the previous expression, but we can infer 
ultrametricity by simply looking at their structure. The function -P((?i2, 913, 923) can be reconstructed 
later in an indirect way from the distribution of the weights we will describe below (section 3). 

Let us consider the solution for a given pd'. a simple analysis of figure (2) shows that for any three 
replica indices a, b, and c, the corresponding overlaps Q\ a b,Pac and P c b always form an isosceles triangle 
with the two equal sides smaller or equal to the third. However, while Q\ a b can take values from zero 
to 5_eai, Pac and P c t can take values from zero to pd- Considering other solutions, we obtain values of 
P between and qiEA- Now, since ultrametricity is a property of all the solutions, it will be a property 
of the sum over solutions as well; therefore the overlaps between any three states at any temperature 
satisfy ultrametric relations. In general, the maximum overlap between a state at temperature T\ and 
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Figure 2: The global matrix Q for a given pd- Qi is at the left high corner, Q 2 at the low right corner, 
P at the left low corner. If we consider two replicas a and b at temperature T\ such that Q\ a b > Pd the 
overlaps P ac and P c b with a replica c at temperature T 2 verify P ac = Pb c < pd] if Qiat < Pd then we may 
have P ca = Qiab < Pcb, or P c & = Q\ a b < Pea, or P c (, = P ca < Q\ a b] i-e. we have ultrametric relations 
between replicas at different temperatures. 



another state at temperature T 2 is equal to the self-overlap of the state at the higher temperature. Perfect 
ultrametricity between states at different temperatures is a special property of this class of models which 
relies on the identity of the three function q%(x), q2{x) and p(x) in the small- a; region. 

As we said in the introduction, the ultrametric relations between the overlaps of states at different 
temperatures define a correspondence between the trees of states. Consider a cluster ii of equilibrium 
states at temperature T\ whose overlaps are greater or equal to some q\ . Given a state a in /i, we have 
that the overlap between any other state j3 in I\ and any state 7 outside I\ is simply given by qp 1 = q a ~ ( 
M. Now, given a state a' at T 2 whose overlap with any of the states in Ii is greater or equal to qi, we 
have that the overlap between a' and any state 7 at Ti outside I\ is simply given by q a > 7 = g Q7 ; In other 
words, from a geometrical point of view we may assume that a' is in I\. Furthermore, this is true for 
all the states at T 2 whose overlap with a' is greater or equal than qi; by definition they form a cluster 
I2 which we call the "twin" of I\. As far as the overlaps are concerned the two clusters I\ and I2 can 
be considered the same; therefore from a topological point of view there is only one tree of states whose 
details are revealed by lowering the temperature. Finally, we recall that the solutions we described satisfy 
the separability property (3^, [l7| , which means that the overlap contains all the information between two 
states at equal or different temperatures. 
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3 The distribution of the weights 

Each state of a spin-glass system at a given temperature has a certain statistical weight P a . The fluc- 
tuation of the weights with the disorder can be described through the following procedure pi |28| 
involving the free energies of the states defined as P a — exp[— f3f a ]/ X)fc ex P[ — Pfk]- Given the tree of 
states, we consider a given level and assign to each cluster of states at this level a reference free energy 
chosen randomly such that the average number of clusters reference with free energy between / and f + df 
is given by 



<LAf(f)=exp[l3x(q k )f}df 

After applying the procedure to any level of the tree we define the free energy of a given state as the sum 
of the reference free energies of the cluster to which it belongs at the various levels. For instance, if the 
state a belongs to the cluster i\ at the first level of the tree, to the cluster i\ii at the second level of the 
tree and so on, its free energy is given by 

fa = fit + fii%2 ""t" /ii»2»3 + ■ • • + fiii 2 i 3 ...iL-i + fi 1 i 2 i3---iL-ia (8) 

We have established that the trees of states at different temperatures are equal: to a cluster of states 
at T\ corresponds a cluster of states at Ti\ therefore we want to know which is the relation between the 
corresponding reference free energies. This correlation can be obtained computing the quantities 

i 

Where the index I refers to the clusters at a certain level q of the tree and Wi \ and Wi 2 are the weight 
of the cluster I respectively at temperature T\ and T2. Through standard manipulation fij] we obtain 



Mk o = ^2 Pa 1 ---Pa k Pb 1 ---Pb J ®{qa 1 a 2 -q)---Q{qa 1 a k -q)Q{qa 1 b 1 -q)---Q{qa 1 b J -q) = 

ai...Ofe6i...6j 

= lim n 'Yl Q{Qla 1 a 2 -q)-.-Q{Qla 1 a k -q)Q{Pa 1 b 1 -q)---Q{Pa 1 b j -q) 

all solutions 

Again, the problem is reduced to the computation of a sum over all the solutions of the SP equations. 
We are unable to perform such a sum but we have a line of reasoning to guess which may be the 
result. Indeed, the previous expression does not depend on the model under consideration; it is a general 
outcome of the replica trick. Therefore, if we have two different models with the same set of solutions the 
corresponding weight distribution functions will be equal. The solutions (|],f|) found above are formally 
the same which have been found with a similar treatment of the GREM Jig ], with a scaling qi(x) — 
q%{ x ) — p{ x ) — <Zu((/3i + 02)x) hi the small-x region. In other words, for any solution with F ^ of 
the spherical model with multi-spin interactions there is a corresponding solution of the GREM with 
the same parameterization. Since there is a one-to-one correspondence between solutions of the GREM 
and solutions of the multi-p-spin spherical model, we expect all the quantities of interest to have the 
same formal dependence on the temperatures and on the universal function q u (y). This correspondence 
prompt us to conjecture that the structure of the correlations between the weights is the same in the two 
models, i.e. that the reference free energy of a given cluster at temperature T\ is equal to the reference 
free energy of the corresponding cluster at temperature T2. To be precise one should notice that the q{x) 
of the GREM has a qualitatively different shape from that of the models we are considering; indeed the 
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solutions of the GREM does not have a plateau at q m ax and furthermore q(x) — for x < T/T c . This 
makes no difference at all: since the solutions has the same formal expression in terms of the function 
y u (q), the formal expressions of quantities like the P(qT\T2) must be the same, and the difference between 
the two models is only in the actual value of y u {q)- 

According to the previous argument the reference free energies of the various clusters are fixed at all 
temperatures, in particular the ordering of the clusters according to them does not change; however, this 
does not mean that the ordering of the clusters according to their actual weights is also conserved: this 
is only true on average. In other words, it is not true that to the heaviest cluster at a given temperature 
corresponds the heaviest cluster at a lower temperature. 



4 Solutions with Different Parameterizations 



In the previous sections we saw that in order to obtain the quantities of interest we should perform sums 
over all the different solutions of the SP equations of the functional (||). Here we intend to discuss one of 
the main difficulties which prevents us from performing such sums, i.e. the existence of an infinite set of 
solutions corresponding to different parameterizations of the 2n x 2n order parameter Q. 

By applying the same technique of section 2 to the REM |3(| we found the same essential features 
of the problem. Here the solution of the standard isothermal problem is a very simple q{x) whose value 
is for a; < 1/(3 and 1 for x > 1//3; this is the simplest case of a solution that verifies the so-called 
Parisi- Toulouse scaling q{x, T) — q u {(3x) Q|, which is also found in models with full RSB like those we 
are considering. 

As we saw in section 2 the problem is connected to the extremization of the quantity In Z n (T\)Z n (T-2) 

Qi P 
P f Q 2 

are nx n matrices. One can show that there exist solutions of the type (^,0) for the REM; in particular, 
we have that Qi,Q2 and P are 1RSB matrices with values for ir < + P2) and I for x > l/(/3i + fa). 

In the solutions (||J^) the matrices Q%, Q2 and P are Parisi matrices, but there exist other solutions 
corresponding to different parameterizations. For instance we can divide each of the three matrices Qi, 
Q2 and P in four blocks of size n/2 x n/2. We have then 16 blocks and we can parameterize each of 
them as a Parisi matrix. In the n — > limit the corresponding SP equations are the same obtained by 
considering four different system, two of them at T\ and the other two at T 2 . The order parameter in the 
latter case is a An x An matrix composed of 16 matrices of size n x n 



with respect to the order parameter which is a 2n x 2n matrix Q = 



, where Qi, Q2 and P 



Q = 



( 


Qn 


Q12 


Pl3 


Pli 


\ 




Q12 


Q22 


P23 


P24 






Pl3 


P23 


Q33 


Q34 




\ 


Pli 


P24 


Q34 


Q44 


/ 



(9) 



When we parameterize each of these matrices through Parisi functions q\\{x) ,q\2{x) . . . and take the limit 
ri —> the corresponding equations are identical as they would be if the size of the matrices were n/2 
rather than n; in other words, the solutions of the four-system problem are also solutions of the two- 

Qi P 



system problem, and they offer another way of parameterizing the order parameter Q 



P* Q2 



9 



This argument can be extended indefinitely considering at the same time a general number of 2p systems, 
p at temperature T\ and p at temperature T 2 . In this way an infinite set of possible parameterizations of 
the 2n x 2n order parameter Q in terms of Parisi matrices is obtained . 

However, not all the parameterizations give new solutions. Going back to parameterization (^|) we 
have 16 Parisi matrices to consider; in the REM we have a solution in which they are all equal 1RSB 
matrices with a breaking point x c = l/(2/3i + 2/3 2 ). It can be seen that this is nothing but a permutation 
of the solution in which Qi,Q2 and P are 1RSB matrices with x c = l/(/3i + $2) (see also the discussion 
in the Conclusions). Therefore the 4-system parameterization does not add anything new in this case. 
However, the 4-system parameterization describes also the following solution 

x< 1/(2/?! + /? 2 ) 
x>l/{2fa+fo) 

x < I/P2 
x > 1/(32 

(10) 

This solution cannot be obtained through a permutation from the solution of the type (^,0) and should 
be counted separately. Essentially, this parameterization corresponds to two systems (system 1 and 
2) at temperature T± correlated with a system at temperature T 2 (system 3), while system 4 at T 2 is 
completely uncorrelated to the remaining three. Accordingly, in summing over all the different solutions 
we must consider the infinite set of solutions whose parameterization corresponds to a generic number 
of mi systems at temperature T\ correlated to a generic number of m 2 systems at temperature T 2 , plus 
vri2 — tti\ (if m 2 > mi) uncorrelated systems at temperature T± (in order to have the same number of system 
at each temperature). The scaling of the correlated components is q{x,T\ 1 T2) — q u ((mi/3i + m 2 /3 2 )x), 
i.e. in the REM the correlated components are described by 1RSB function with x c — \j(m\fi\ +m 2 /3 2 ). 

According to [I] any solution with a given parameterization can also be considered as solution of 
a certain constrained system. For instance, the blocks Qii,Q 22 ,<333,Qi 2 ,i : i3,-f 2 3, in the solution ( |j"o| ) 
correspond to a system of three real replicas which are constrained to have maximum overlap (i.e. 1 in 
the REM) among themselves. When considering a constrained system the problem of summing over all 
solutions greatly simplifies; indeed in this case we have only one solution plus its natural permutations 
and we can perform the sum in the standard way by replacing it with a sum over indices. The result is 
immediate, for the P(q) of the constrained system we have P(q) = 8{q)/{2(3x +/3 2 ) + 5(q— 1)(1 — l/(2/3i + 
/? 2 )). We define the "free energy" f a of a state of the global system (composed of two constrained 
systems) as P a = exp[— f a }/ exp[— fp] (see footnote 1). Then we obtain that these free energies are 
independent random variables such that the average number of states with free energies between / and 
/ + df is dAf (f) = exp[//(2/3i + /3 2 )]c(f. This result is precisely what is obtained noticing that the states 
of the constrained system are triplets of identical states of the single system; therefore in the REM their 
free energy is simply given by ^constrained _ (2fi x _|_ /3 2 )/^ n ^ e (see footnote 1) and the distribution of 
y-single j g p r0 p 0r ti ona i to exp[/3ixi/] = exp[/3 2 cc 2 /] = exp[/]. The same line of reasoning applies to the 
models we considered in the previous sections as well: it ensures that the results obtained by considering 
constrained systems (the only case in which we are able to sum over the solutions explicitly) are fully 
consistent with our guess on the distribution of the free energies made in section 3. 



qu{x) = g 22 (x) = 1733(2;) = quix) = pi 3 {x) = p 2 3(x) = 

344(2:) = 
Pu(x) = P2a(x) = q3±(x) = 



for 

1 for 

for 

1 for 
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Conclusions 



We proved the existence of correlations between the equilibrium states at different temperatures of the 
spherical spin-glass models with multi-p spin interactions for values of the coupling constants such that 
they display full RSB: there is no chaos in temperature in such models. Furthermore, the overlaps 
between states at different temperatures satisfy ultramctric relations. Ultrametricity determines a one- 
to-one correspondence between the trees of states at different temperature: to any cluster of states at 
temperature T± at a given level of the tree corresponds a "twin" cluster of states at temperature T2; 
the precise meaning of this correspondence has been discussed in details in the introduction and in 
section 2. From a purely geometrical point of view we may say that there is only one tree of states 
at all temperatures, whose details are revealed lowering the temperature. Prompted by some technical 
features of the problem, we conjectured that the reference free energies of two twins clusters are equal 
at all temperatures, exactly as in the GREM. Consequently, we expect that quantities like the P(qTiT2) 
in these models are the same as the GREM. More precisely we expect them to have the same formal 
dependence on the temperatures and on the function y u (q), whose actual values will be different in the 
two classes of models. 

The scenario of a tree of states which bifurcates when lowering the temperature was suggested early 
in spin-glass studies [ |32"| and was later advocated in order to explain the phenomenology of rejuvenation 
and memory in spin- glasses H. According to our findings, the basic premises of that phenomenological 
picture of off-equilibrium dynamics hold for the class of models considered here; we believe that this 
further increases the need for a complete understanding of the relationship between the equilibrium 
energy landscape and the off-equilibrium dynamics in spin-glasses. 

Within the TAP approach Q |3j| strong correlations between the equilibrium states at different 
temperatures are readily obtained in the spherical p-spin model with 1RSB |34|, |3^, ^6). Indeed in this 
model the angular and the self-overlap contributions to the TAP free energy can be factored; that is if 
we write = q^^rni , we have that the angular part enters the expression of the TAP free energy 
only in the form E p = q p / 2 ^ </i 1 i 2 ...i P r "'ii r ^i2 ■ ■ ■ Accordingly, the angular components of the states, 
which are the extrema of the free energy, are the same at all temperatures. To our knowledge this was the 
only result on the absence of chaos previously obtained for a spin-glass model. The previous argument 
cannot be used in dealing with spherical spin-glass models with multi-p interactions for values of the 
coupling constants such that they display either 1RSB or full-RSB. For instance, in the q 2 — q 4 model 
there is an angular dependence of the form E = g ^ JijihiThj +q 2 X) Jijkimimjrhkrhi and no factorization 
is possible. Indeed, when the temperature changes the self-overlap changes with it causing the angular 
landscapes corresponding to the two interactions to interpenetrate. It would be interesting to understand 
how this process leads to the properties we found within the replica approach. Furthermore, we recall 
that the off-equilibrium dynamics [p5[ i s connected to the TAP free-energy landscape f4(i|| . 

As discussed in [I] , the solutions (|6|,0) have the same free energy of the P = solution. This can be 
also derived noticing that they form a continuous line in the space of the matrices Q parameterized by 
the value of the continuous parameter pd- The value pd = corresponds to the standard Parisi solutions 
at the two temperatures. On this continuous line of solutions we have dF/dQ — by definition; therefore 
the free energy is constant and equal to that of the pd — solution. The previous argument has deep 
consequences. It provides an easy way to understand the Goldstone Theorem for disordered systems with 
full RSB which has been proved and discussed in |}9| . This theorem connects the presence of Goldstone 
modes in spin-glasses with continuous RSB with the fact that the discrete permutational symmetry within 
the replica approach becomes a continuous symmetry when the number of RSB steps goes to infinity. 
Consider the standard replica formulation of a given model: it deals with a n x n order parameter Q a b- 
Instead of making the Parisi ansatz on it, we can divide it in four n/2 x n/2 blocks and make the Parisi 



If 



ansatz on each of these blocks separately, i.e. we assume that the two diagonal blocks are equal to an 
ultrametric n/2 x n/2 matrix q a b and the two off-diagonal blocks are equal to a n/2 x n/2 ultrametric 
matrix p a b. Then the SP equations are written in terms of two functions q(x) and p(x) defined on the 
interval [l,n/2], but in the n — > limit the equations are identical to those obtained considering 2n 
replicas with an order parameter Q parameterized by four n x n matrices, the two diagonal ones equal 
to Qab and the two off-diagonal ones equal to P a b. This is a special case (Ti = T 2 ) of the problem we 
considered in this paper. In this case |37j the solutions corresponding to (J6|J^) read 

q(x) = p(x) = q Parisi (2x) < x < \x Par i S i{pd) 

q{x) = p(x) = p d \xp arlsi {pd) <x< XParisiipd) 
q(x) = qparisi(x);p{x) = p d x Parisi (p d ) < x < 1 (11) 

Where qp a risi{%) is the standard Parisi solution and p d is a continuous parameter with range [0, (7.ea]; 
every value of p d specifies a solution. As stated above, these solutions, first obtained considering 2n 
replicas, solve the standard n-replica problem too. At this point we can make the following statements: 

• These solutions exist in every model with Parisi RSB, either discrete of continuous. This statement 
has already appeared in fl6|| where it is claimed that it is implied by ultrametricity. We justify this 
result noticing that these solutions are permutations of the standard Parisi solution, as it is readily 
understood considering fig. (^). 

• When the model has full RSB the parameter pd is continuous, therefore the solutions form a 
continuous line of constant free energy. As a consequences on every point of the line the Hessian 
has zero eigenvalues. 

Acknowledgements. I thank S. Franz, G. Parisi and L. Pcliti for interesting discussions. It's a pleasure 
to thank my family for constant help and support. 



Appendix 1 

In this appendix we derive the formulas to compute a generic function (e.g. inverse, logarithm. . . ) of one 
or more Parisi matrices. Using the standard eigenvalue technique one encounters some difficulties. The 
main problem is that in the n — > limit the matrix ceases to be determined univocally by the set of its 
eigenvalues. For a generic Parisi matrix parameterized as (a d ,a(x)) the eigenvalues are |34[| 

A Q (0) = a d - J^a(y)dy deg : 1 (12) 

\ a (x)= a d - xa(x) - f\(y)dy deg: ~ n< ^ (13) 

Two important eigenvalues are A a (0) = a d — a and A a (l) = a d — a(l), in this context the bar means 
integration of the Parisi function a(x) over the interval [0,1]. By direct inspection one can check that 
the eigenvalues verify the property A a *b(a;) = X a (x)Xb(x), where a * b(x) is the product of Parisi algebra 

(a * b) d = a d b d - \ a(y)b(y)dy = a d b d - ab (14) 
Jo 

(a*b)(x) = (a d -a)b(x) + (b d -b)a(x)- / (a(x) - a(y))(b(x) - b(y))dy (15) 
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(a) 



(b) 



Figure 3: (a) The solution of a generic spin-glass problem with 1RSB. (b) A permutation of the solution 
(a) which corresponds to a parameterization of the n x n order parameter as four n/2 x n/2 Parisi 
matrices. The generalization to full RSB is straightforward. This figure shows that the solutions ( |il"| ) 
are obtained from a permutation of the standard Parisi solution qp a risi{x), in particular the origin of the 
small- a; scaling q(x) — p(x) = qp a risi{2x) is clarified. 



It can be easily checked that the n x n matrix C that projects on the vector of constant coordinates 
(i.e. C a b — 1 \/ab ) has all zero eigenvalues in the limit n — > 0. As a consequence the set of eigenvalues 
ceases to determine the matrix A in a unique way. To recover the function (ad,a(x)) we need further 
information e.g. a(0). Using a(0) and the relation xa(x) — —X a (x) (the dot means derivative with respect 
to x) which follows from the expressions ( |l2| , |l3"|) we obtain the following inversion relations 

a(x) = a(0) - f ——\a = a(0) + ^t^M + f %(\ a {0) - X a (y)) (16) 

Jo y x Jo v 

a d = A o (l)+a(l)=a(0)+A o (0)- / %(X a (y) - A o (0)) (17) 

Jo y 

Given a function f[a] = fkd k we want to compute f[A] for a generic ultrametric matrix A. The 
eigenvalues \f[A] oi f[A] are readily obtained 

\ f[A] (x) = f[X a (x)} (18) 

To use the formulas ( ^6|JT^ ) we need to know /[A](0). The expression for a product is 

(ab)(0) = (a d - a)b{0) + (b d - b)a(0) = A 6 (G)<z(0) + A„(0)6(0) (19) 

As a consequence we have the following expression for the powers of A 

(a n+1 )(0) = A«(0)(o n )(0) + A«(0) n a(0) — » (a n )(0) = n(a d - ^"-^(O), (20) 

therefore 

da 



/[A](0) = ^ /fc(« fc )(0) = J2 ~ a) fc_1 «(0) = a(0)f-Ki - 3]. (21) 



A- 
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Summing up, the expression of a generic function f[A] is 

f[A](x) = a(0)^[a d -a]+£dya^[\ a (y)} (22) 

! T n,, tn\ d f \ -l i t \ -l f 1 fl X a(y)} ~ f[a-d ~ a] 

-Tr/[AJ = a(0) — [a d -a\ + f[a d -a\- ^ d V ( 23 ) 

n aa Jo V 

The generalization to a function gLAi, . . . , A p ] of p Parisi matrices the function is straightforward 

P Qg 

g[Ai, . . . , Ap](x) = fflj(O) — [aid - Qi, • ■ • , %>rf - a P ] + (24) 

2—1 1 

+ f dyY^aAxA,,...,^] (25) 
1 P dg 

-Tr g[Ai, ... A p ] = } a^O) — [a ld - o x , . . . , a pd - a p ] + g[a ld -ai,...,a pd - a p ] + (26) 

-dtf (27) 



1 3[^a i; ■ ■ -,XA p ](y) - g\au -ai,...,a pd 



ir 



Appendix 2 

In this appendix we check that the solutions verify the SP equation. We consider the general 

situation where a non zero magnetic field is present. The Free energy functional read 



F n = -01 Y^UiQiab) + H 2 Q lab ) ~ 0iY,{f(Qi*b) + H 2 Q 2ab ) 

ab ab 

- 2fafa ^2(f(Pab) + H 2 P ab ) - TrlnQ - n (28) 



32 \ 



The dependence on Q can be simplified trough TrlnQ = Trln(QiQ 2 — P )■ The SP equations then read 



ftf\Qi at) + PlH 2 = - ( 4 1 = - ^ (29) 

VQ/ lafc Q1Q2-P 2 

(3i(3 2 f'(Pab) + NhH 2 = -(^) = n / p2 (30) 
We recall the definition of the temperature-independent function y u (q) and of its inverse q u (y) 

yM = WW* m 

The self-overlap Qea(P) of the equilibrium states at a certain temperature is given by 

" d -" EA ^J7m7i (32) 
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The minimum overlap qn in presence of a magnetic field H is independent of the temperature and is 
given by 

H 2 = q H f"(q H ) - f'(q H ) (33) 



In presence of a magnetic field the generalization of the solutions (H,M) is 







for 


< x < ^l^VuiqH) 




9u((A +fo)x) 


for 




9*0*0 = < 


Pd 


for 


01 l 02 yu(pd) <x< pVuiPd) 




qu(Psx) 


for 


j- s Vu{Pd) <x< j- s y u {q E A{Ps)) 






for 


J-VuilEAiPs)) <x<\ 




qn 


for 


0<x< 0i lp 2 y u (qH) 


p(x) = < 


q u ((Pi+P 2 )x) 


for 


Pl l P2 yu(q H ) <x< Pi l P2 Vu{Pd) 




Pd 


for 


01 l 02 Vu{Pd) <x<l 



(34) 



(35) 



These solutions are valid for any couple of temperatures T\ > T 2 both below the critical temperature 
and for any pd between qu and 91 (1) which is the self-overlap of the states of the system at the higher 
temperature. To check that they verify the SP equation ( p9| , [30|) we need to express their r.h.s. in the 
Parisi form, this is readily done applying equation (|25|) 



-Qi 



Q1Q2-P 2 



(x) 



(q2d ~ g 2 ) 2 9l(0) + (p d -P) 2 q2(0) - 2{q 2d - q 2 )(p d - p)p(0) 



dy- 



((q2d - q2)(qid - qi) - (pd -p) 2 ) 2 
Ag 2 9i + A p92 - 2X q2 X p p 



P 



Q1Q2-P 2 



(x) = dy 
'0 



{X qi X q2 — A 2 ) 2 
X q2 X p qi + X P X qi g2 - X p p - X q2 X qi p 
{X qi X q2 — A 2 ) 2 



(36) 



(Pd -p){qu - 91)92(0) + {Pd-p){q2d - 92)91(0) - (p d -p) 2 p(0) - (qid - 9i)(92d - 92X0) 



(37) 



((92d - 92)(9id - 9l) - (Pd ~ P) 2 ) 2 
In the small- a; region the three functions are equal so the previous expressions simplify in this region to 



-Qi 



Q1Q2 - P 2 
p 

Q1Q2 - P 2 



(x) 
(x) 



(A ?2 (9ff) - A p (9ff)) 2 



(A g2 A gi (q H ) - Xl{q H )) 2qH 



{X q2 {q)-X p {q)f 



> qH {\2\Aq) - tf>{q)) 

(Ap(9ff) - X q2 (q H ))(X p (q H ) - X qi (q H )) 



(A 92 A 9l (gif) - X p (qn)) 2 

(X p (q)-X q2 (q))(X p (q)-X qi (q)) 
(A g2 A 91 (g)-A 2 ( 9 )) 2 



■qH 



dq 



(38) 



(39) 
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The various quantities entering the previous expressions read 

K (?) = Tr-br f ~r— + < 2/Pl 1 for x < *(pd) 
X «M= forx>^) 



A p (p) =0 for x > x{p d ) 

When evaluating the quantities entering the integrals the dependence on pa disappears so as the discon- 
tinuity at x{pd)'- 

{X q2 (q) - X P (q)) 2 a% .„, , (X p {q) - X q2 {q)){X p (q) - X qi (q)) „. , . 

_ Pi j w\ 7T — \ — r~\ — \?t w? = P1P2J yq) (.4i; 



(X q2 X qi (q) - W<l)) 2 ™ w ' (A, 2 A 31 (g)-A2(g))2 
Evaluating the integrals in ( |3"§j , |39| ) through (^lj) we obtain 



Q1Q2-P 2 



(x) = /3?(/'(gi(x)) + /"( (Zff ) (Z H-r(^))=/3 1 2 (/'((7i(x))+ J ff 2 ) (42) 



/7 (*) = /3i/32(/'(p(x))+r( W ) te -/'( (?ff ))=/3 1 /3 2 (/'(p( a ;))+i/ 2 ) (43) 



Q1Q2-P 2 



Therefore the SP equations are verified in the small- x region; now for x > x(pd) we have p = and 
A p — so the equation for p is immediately verified while qi{x) and q2(x) decouple 

~ n " , -Q2 , , « f qi(x) dq 

X ) = + Tf- = (44) 



QiQ2-P 2 " ' QiQ2-P 2K yL " J Pd XI 

= 01 (f'iPd) + f"(q H )q H - f'(q H ) + f(qi(x)) - f( Pd )) = (3 2 (f( qi (x)) + H 2 ) (45) 

We skip the explicit evaluation of the free energy; it turns out to be the sum of the free energies at 
temperature Ti and T2, as it should. 
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